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1. INTRODUCTION 

1.1 Purpose 

This document provides an overview of technical requirements for transporting time 
division multiplexed (TDM) digital signals over a packet-oriented multi-protocol label 
switching (MPLS) network. The transmission system for circuit-oriented TDM signals is 
synchronous optical network (SONET). To support the TDM traffic, which includes 
voice, data and private leased line service, MPLS network must emulate the circuit 
characteristics of SONET payloads. HDLC-like point-to-point protocol (PPP) and MPLS 
shim header are used to encapsulate TDM signals and provide the circuit emulation 
service (CES). 

The objective of this document is to examine the synchronization criteria of the SONET 
transmission system, define TDM segmentation and reassembly (S AR) functions that 
meet the criteria, and resolve encapsulation issues, such as packet overhead and payload 
sizes, regarding CES over MPLS network. 

1.2 Scope 

The architecture described in this document will be used as the basis for the development 
of a TDM S AR. The TDM SAR provides CES over MPLS network for the following^ 
digital signals. ~C^- 

1) STS-1 synchronous payload envelop (SPE) 

2) STS-Nc SPE (N = 3, 12, or 48) £ 

Other SONET signals, such as virtual tributary (VT) structured sub-rate mapping, are not 
supported. Since encapsulated TDM packets are transported on an OC-192c line, highest 
SONET signals supported is STS-48c. 

This document illustrates the functional requirements of the TDM SAR chip. Some 
design details, such as I/O pin designation, memory/register arrangement, and timing 
analysis, may be included. They are for references only. Actual chip design is beyond the 
scope of this document. 

1.3 Acronyms 

See "Technical Word List." [io] 
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2. OVERVIEW 

2.1 SONET Rates and Formats 

The basic SONET modular signal is the synchronous transport signal-level 1 (STS-1). A 
number of STS-ls may be multiplexed into higher-level signals denoted as STS-N with N 
synchronous payload envelopes (SPEs). The optical counterpart of the STS-N is the 
optical carrier-level N or OC-N. Table 2-1 lists standard SONET line rates supported in 
this document. 



OC Level 


OC-1 


OC-3 


OC-12 


OC-48 


OC-1 92 


SDH Term 




STM-1 


STM-4 


STM-16 


STM-64 


Line Rate (Mb/s) 


51.840 


155.520 


622.080 


2,488.320 


9,953.280 



Table 2-1. Standard SONET Line Rates 



Each SONET frame is 125 jus and consists of nine rows. An STS-N frame has nine rows 
and N*90 columns. Of the N*90 columns, the first N*3 columns are transport overhead 
and the other N*87 columns are SPEs. A number of STS-ls may also be linked together 
to form a super-rate signal with only one SPE. The optical super-rate signal is denoted as 
OC-Nc, which has a higher payload capacity than OC-N. 

The first 9-byte column of each SPE is the path overhead (POH) and the remaining 
columns form the payload capacity with fixed stuff (STS-Nc only). Figure 2-1 shows an 
STS-1 or STS-Nc frame. 





Trace (Jl) 


■' . " ; - ; ? ; ;.v;; ; ; . ••' 






BLP-8 (B3) 






Transport 


Signal Label (C2) 


^i^itiXeal^- 


Payload Capacity 


Overhead 


Path Status (Gl) 


/Stuff, 


N*3 


User Channel (F2) 


wm 


86 columns for STS-1 


columns 


Indicator (H4) 


columns} 


N*87 - N/3 columns for STS-Nc 




Growth (Z3) 








Growth (Z4) 


STS-Nc ; 






Tandem (Nl) 







Figure 2-1. STS-1 or STS-Nc Frame 



The POH of an STS-1 or STS-Nc is always nine bytes in nine rows. The payload capacity 
of an STS-1 (no fixed stuff) is 774 bytes per frame. The payload capacity of an STS-3c is 
(3*87 - 1)*9 = 2,340 bytes per frame. There is no fixed stuff for an STS-3c either. The 
payload capacity (without fixed stuff) of a concatenated STS-Nc, where N > 3, has (N*87 
- N/3)*9 bytes. For instance, the payload capacity of an STS-192c is 149,760 bytes, 
which is exactly 64 times bigger than the STS-3c's. The fixed stuff (shaded area) of an 
STS-192c is 63*9 = 567 bytes. 

There are 8,000 SONET frames per second. Therefore, the SPE size, POH plus payload 
capacity, of an STS-1 is 783*8*8,000 = 50.1 12 Mb/s. The SPE size of a concatenated 
STS-3c is 2,349 bytes per frame or 150.336 Mb/s. The payload capacity of an STS-192c 
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has 149,760 bytes per frame, which is equivalent to 9,584.640 Mb/s. Table 2-2 lists the 
SPE and payload rates supported. 



STS Level 


STS-1 


STS-3c 


STS- 12c 


STS-48c 


STS- 192c 


Payload Size (Bytes) 


774 


2,340 


9,360 


37,440 


149,760 


Payload Rate (Mb/s) 


49.536 


149.760 


599.040 


2,396.160 


9,584.640 


SPE Size (Bytes) 


783 


2,349 


9,396 


37,584 




SPE Rate (Mb/s) 


50.112 


150.336 


601.344 


2,405.376 





Table 2-2. Pavload Size and Rate 



Different services (TDM, ATM, PPP over SONET, etc.) are mapped into STS payloads 
differently. The STS path signal label (C2 byte in POH) indicates the construction and 
content of the STS SPE. Table 2-3 listed the C2 assignments that are supported. 



Byte C2 Code (Hex) 


Construction and Content of the STS SPE 


00 


Unequipped 


01 


Equipped — Non Specific Payload 


13 


Mapping for ATM 


CF 


Point-to-Point Protocol over SONET 



Table 2-3. C2 Assignments Supported 



In TDM service (circuit emulation), the entire SPE of a lower STS level is encapsulated 
into PPP packets and transported in the payload area of a higher STS level. Services other 
than TDM are supported through a PMC multi -service chip[8]. 

2.2 SONET Line Interface Cards 

The first product release supports two types of line cards: 10 Gb/s trunk I/F and 4 * 2.5 
Gb/s port I/F. The trunk I/F card uses a single OC-192c for interfacing with the MPLS 
network. The OC-192c trunk I/F card is connected to the Vivace packet parser (PP) chip 
through a 128-bit POS-PHY type bus. 

The port I/F card has four plug-in modules and each plug-in module may have one of the 
three SONET line interface types: single OC-48, quad OC-12, and quad OC-3. There is 
one TDM SAR on each I/F module. Four modules, with combined rates up to 10 Gb/s, 
may be connected to the PP chip through four sets of 32-bit POS-PHY level 3 buses. 

2.2.1 Single OC-48 I/F Module 

A single OC-48 I/F module consists of a PM5315 SPECTRA-2488 payload alignerm, a 
PM7390 MACH-48 channelized multi-service access devices, and a TDM circuit 
emulation SAR. The TDM SAR lies between the PMC chips and the Vivace PP chip. It 
performs circuit emulation on selected STS channels. The TDM SAR also adds/drops 
non-TDM traffic from/to the PM7390. The PM7390 interfaces with the PM5315 and PP 
chip indirectly via the TDM SAR 
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The PM5315 is configured to the single STS-48 mode. In this mode, it supports a duplex 
16-bit 155.52 MHz differential PECL line-side interface for direct connection to external 
clock circuitry and optical transceivers. Figure 2-2 shows the VF module. 




Figure 2-2. Single OC-48 Interface Module 

The PM53 15 interfaces electrical optical components in the line-side and performs 
SONET section, line, and path termination. In the system-side, it supports a 32-bit 77.76 : 
MHz telecom bus (TCB) directly connected to the TDM SAR. 

The PM7390 MACH-48 is an ATM and packet processor. It implements the ATM Forum 
UNItii], PPP over SONET[i2,i3], and ANSI T1.107[m,is] (for DS3) specifications. The chip 
provides programmable assignment of STS-1 timeslots to arbitrary DS3, STS-1, STS-3c, 
STS-12c, or STS-48c channels. PM7390 has a 32-bit 77.76 MHz TCB line-side and 32- ^ 
bit 100 MHz POS-PHY Level 3 system-side interfaces. 



The TDM SAR chip provides independent time-slot interchange blocks on the incoming 
and out going TCB interfaces to allow arbitrary arrangement of timeslots at STS-1 
granularity. The SAR has two 32-bit TCBs, one for PM5315 and the other for PM7390, 
and two POS-PHY Level 3 interfaces, one for PM7390 and the other for the PP chip. 

2.2.2 Quad OC-12 1/F Module 

The quad OC-12 I/F module consists of a PM5315, a PM7390, and a TDM SAR. The 
PM5315 is configured to support four duplex 8-bit 77.76 MHz TTL compatible line-side 
interfaces. In the system side of the PM5315, the 32-bit 77.76 MHz TCB is broken down 
into four 8-bit TCBs, each carrying a byte-interleaved OC-12 stream. The line-side 
interfaces of TDM SAR and PM7390 are configured to support four 8-bit TCBs also. 
Figure 2-3 shows the VF module. 
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8 KHz 



Figure 2-3. Quad OC-12 Interface Module 
2.2.3 Quad OC-3 I/F Module 

The quad OC-3 I/F module uses a PM5316 SPECTRA-4X155[i7] instead of the 2.5 Gb/s 
PM5315. The 622 Mb/s PM5316 is configured to support four 155.52 Mb/s differential 
PECL line-side interfaces. In the system side of the PM5316, a single 8-bit 77:76 MHz 
TCB, carrying byte-interleaved OC-1 2 stream, is used. The other three TCBs are forced 
to low. The line-side interfaces of TDM SAR and PM7390 are configured to support only 
the first of the four 8-bit TCBs. Figure 2-4 shows the I/F module. 




19.44 MHz 



77.76 MHz 

Figure 2-4 



Quad OC-3 Interface Module 
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2.3 Timing Models 

SONET network elements (NEs) are required to have an internal clock of ± 20 ppm 
minimum free-run accuracy. The free-running clock may be synchronized with network 
clock using one of four timing modes: external, through, loop, or line. Figure 2-5 
illustrates the four timing modes. 



External timing, as shown in Figure 2-5a, from a building integrated timing supply 
(BITS) is the preferred mode of synchronizing SONET NEs. However, it might not be:|, 
possible to synchronize the entire MPLS network with a stratum-3 (or better) BITS ciock. 
If a BITS clock is not available, then a selected reference clock received from one of the 
SONET lines (Figure 2-5d) shall be used for edge switches with circuit emulation 
application. For intermediate switches, through timing or loop timing may also be used. 

2.4 Frequency Justification 

If there is a frequency offset between the frame rate of the transport overhead and that of 
the STS SPE, then the alignment of the SPE shall periodically slip back or advance in 
time through positive or negative stuffing. The stuffing activity takes place in SPECTRA 
when a positive or negative justification event (PJE or NJE), marked by the APL signal, 
is received from the TDM SAR. In drop operation, DPL signals from SPECTRA are used 
by both TDM SAR and MACH-48 to identify PJEs and NJEs for frequency justification. 

Within MACH-48, the 77.76 MHz system clock (SYSCLK) is decoupled from 100 MHz 
POS-PHY clocks (RFCLK and TFCLK) through decoupling FIFOs in ATM and POS 
applications. In the DS3 application, elastic stores provide compensations for frequency 
differences between 44.736 MHz DS-3 streams and the system clock. For ATM with 
DS3 PLCP framing, the 8 KHz REF8K clock is used to lock PLCP frames. 




c. Loop Timing 



d. Line Timing 



Figure 2-5. SONET Timing Modes 
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For the application of circuit emulation over MPLS network, two timing modes are used 
in the TDM SAR: synchronized and adaptive. Figure 2-5 illustrates the two frequency 
justification methods. 
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Figure 2-6. Circuit Emulation Over MPLS Network 

In synchronized mode, the edge switches are synchronized with the BITS clock. The 
positive and negative justification events (PJE and NJE) from local SPECTRA are carried 
over POS to . the far-end TDM SAR.. The TCB output interface block in the far-end SAR 
plays out the justification events to properly align SPEs in transmit SONET frames. 

In adaptive mode, the system clocks in edge switches are not synchronized. Frequency 
offset of an STS channel is compensated through locally generated NJEs and PJEs based 
on the average depth of the channel buffer. If the average buffer depth is increasing, then 
the TDM SAR issues NJEs to SPECTRA to speed up the transmission of data bytes. If 
the buffer depth is decreasing, then PJEs are sent to SPECTRA to insert positive stuff 
bytes and slow down the transmission rate. 

2.5 Payload Pointer 

The STS-1 payload pointer allows each SPE to float within the STS frame. Thus, the 
differences in phase and frequency between the transport overhead and the SPE can be 
accommodated through pointer operations. The payload pointer, contained in HI and H2 
of the line overhead, designates the location of the Jl byte where the SPE begins. 

If the frame rate of the SPE is too slow with respect to that of the transport overhead, then 
a positive stuff byte appears immediately after the H3 byte in the same frame containing 
inverted I bits in HI and H2. Subsequent payload pointer is the previous pointer plus one 
and the new pointer shall remain constant for at least three frames. 
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If the SPE rate is too fast, then a negative stuff byte appears in the H3 byte in the frame 
containing inverted D bits. Subsequent payload pointer is the previous pointer minus one 
and the new pointer shall remain constant for at least three frames. Figure 2-7 shows the 
STS-1 overheads and pointer operations. 
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Figure 2-7. STS-1 Overheads and Pointer Operations 



On a Vivace I/F module, the pointer operations take place in the PMC's SPECTRA 
(PM5315 or PM5316) chip. In the transmit direction, the TDM SAR marks the JO (trace) 
and JI bytes, in the AJ0J1 signal, for the SPECTRA to calculate both HI and H2 bytes. 
The SAR also marks PJEs and NJEs, in the APL signal, for the SPECTRA to perform 
frequency justifications. In the receive direction, the SPECTRA provides the first SPE 
byte location (JI byte) in the DJ0J1 signal and justification events (PJEs and NJEs) in the 
DPL signal. 
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3. ENCAPSULATION 



3.1 TDM Packets 



The TDM SAR in an ingress switch accepts STS SPEs as raw data and segments them 
into TDM packets. A TDM packet consists of a fixed number of overhead bytes and 
some payload bytes taken from the raw data. The TDM packet is transported over an 
MPLS network to a destination egress switch. The far-end TDM SAR then plays out the 
raw data. Figure 3-1 illustrates the encapsulation of end-to-end TDM packets over MPLS. 
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Figure 3-1, Encapsulated TDM Packet 

At the ingress switch, a TDM SAR de-maps and segments OC-48 data streams into TDM 
packets. A TDM packet consists of a 22-bit flow ID (FID), a 10-bit payload size (N), a 
32-bit TDM header, and N bytes of payload data. TDM packets from up to four TDM 
SARs are first processed by a packet parser in the ingress switch (PPI). 

After processing, the PPI overwrites the 32-bit FTD/N word with a Viva header to convert 
the TDM packet to a Viva packet. The Viva packets are further processed and passed to a 
trunk-side egress PP (PPE) within the switch. The PPE replaces each packet's Viva 
header with two MPLS labels: VC and LSP. The PMC S/UNI 10G takes the resulting 
MPLS packets from PPE and encapsulates them in HDLC-like PPP protocol to be 
transported in an OC-192c line. 



S/UNI 10G in the intermediate switch delineates the packet boundaries using flag 
sequence detection, performs bit de-stuffing, and validates the FCS for each packet. The 
validated packet is sent through the PPI and PPE for label swapping. The label swapped 
packet is then re-encapsulated in PPP protocol by another S/UNI 10G and sent over an 
outgoing OC-192c line. This process repeats itself on each intermediate switch along the 
way until the packet reaches the egress switch. 
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At the egress switch, the encapsulation process is reversed. HDLC envelopes are 
removed and MPLS labels processed. The TDM packet, along with a 32-bit FTD/N word, 
is sent to its TDM SAR for reassembly. Raw data in the TDM packet are extracted by the 
SAR and inserted onto an OC-48 line by a SONET payload aligner (SPECTRA). 



3.2 HDLC-like PPP Packet 



A TDM data stream is segmented into packets and encapsulated in HDLC frames. Each 
HDLC-like PPP packet has a 32-bit TDM header and at least two MPLS labels, as part of 
its information field, to associate the packet with the TDM stream. The HDLC envelope 
is added by a packet over SONET (POS) framer before the packet is transported on an 
OC-192c line. Figure 3-2 shows an encapsulated TDM packet. 
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Figure 3-2. HDLC-like PPP Packet 



1 1 4 bits 



A complete HDLC frame consists of 19 bytes of overheads and N bytes of TDM data. 
This frame size does not include bits inserted for synchronization or transparency (bit 
stuffing). The following provides a description for each field: 

Flag Each frame begins and ends with an 8-bit flag, which binary sequence is 
01111110 (0x7E in hex). Only one flag is required between two frames. 



Address The address field is one byte in size and contains the all-stations address 
(OxFF), which will always be recognized and received. 

Control The one-byte control field, which value is 0x03, identifies the packet as 
unnumbered information (UI) command with poll/final (P/F) bit cleared. 

Protocol The protocol field is two bytes. Its value (0x0281) identifies the datagram 
encapsulated in the information field to be MPLS unicast. 



MPLS 
Labels 



Each proposed MPLS label (LSP or VC) consists of a 20-bit label value, a 3- 
bit experimental use (EXP), a bottom of stack bit (S), and an 8-bit time to live 
(TIL). EXP bits may carry drop precedence. The S bit is set for the VC label 
to mark it as the last entry in the stack. 
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TDM 

Header The TDM header is 32 bits long and consists of the following fields: 

I Sequence 
Number The 16-bit sequence number cycles from 0 to 65,535. 



FCS 



Structure 
Pointer 



The structure pointer points to the Jl byte in the payload area. The 
value is from 0 to 1,022 with 0 means first byte after the TDM 
header. The pointer is set to 0x3FF (1,023) if a packet doesn't 
carry the Jl byte. 



NJE/PJE NJE bit is set, with PJE = 0, for negative justification event. PJE 
bit is set, with NJE = 0, for positive justification event. The event 
is carried in five consecutive packets at near-end TDM SAR 
(transmitter). Far-end TDM SAR (receiver) plays out the event 
when three out of five packets with NJE or PJE bit set are received. 
If both bits are set, then path AIS event has occurred. 

BIP-4 The bit interleaved even parity is over the first 28 header bits. 

The frame check sequence field is optional. If used, it calculated over all bits 
between the opening flag and the FCS, but not including bits inserted for 
synchronization or transparency. •■. 



3.3 Payload Capacity and Rate 

The payload capacity of an OC-192c is 149,760 bytes per frame or 9,584.64 Mb/s. A 
number of STS-1, STS-3c STS-12c and STS-48c circuits may be emulated, with HDLC 
encapsulation, in an OC-192c line. 

3.3.1 Emulate STS Circuits 



An STS-1 SPE has 783 bytes per frame. The 783 bytes may be divided into 6.8684 
blocks of 1 14 bytes each. The block size of 1 14 bytes is chosen so that the packet size, 
including a four-byte TDM header and up to 10 bytes of Viva header, is 128 bytes within 
the switch. When the Viva header is replaced with MPLS labels and the HDLC envelop 
is added, the packet size becomes 133 bytes (see Figure 3-2). Only one HDLC flag and 
two MPLS labels are included in the calculation. Therefore, the combined rate of 163 
encapsulated SPEs is 163*6.868*133*8*8,000 = 9,529.6 Mb/s, which is within an OC- 
192c payload capacity. 

An STS-3c SPE has 2,349 bytes per frame. The entire SPE may be divided into 5.4375 
blocks of 432 bytes each. A Viva packet within the switch is therefore 446 bytes. Each 
HDLC frame becomes 451 bytes long. The combined rate of 61 encapsulated SPEs is 
61*5.4375*451*8*8,000 = 9,573.8278 Mb/s, which can be fit in an OC-192c line. 
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An STS-12c SPE has 9,396 bytes per frame. The SPE may be divided into about 15.0577 
blocks of 624 bytes each. An HDLC frame is 643 bytes. Only 15 SPEs, with combined 
rate of 15*15.0577*643*8*8,000 = 9,294.8166 Mb/s, may be fit in an OC-192c line. 

Similarly, an STS-48c SPE may be divided into about 37.2857 blocks of 1,008 bytes 
each. Three SPEs, with combined rate of 7,352.1433 Mb/s, can be fit in an OC-192c line. 

3.3.2 Example 

About one of every seven STS-1 TDM packets has a valid structure pointer points to the 
beginning of the POH (Jl byte). About one of five STS-3c, one of 15 STS-12c, and one 
of 37 STS-48c packets has the valid pointer. The unused structure pointers are set to 
0x3FF. Figure 3-3 shows six consecutive TDM packets of an STS-1 stream. 



1 22-bit 1 10-bit 
P"flow ID~*p pkt size"* 


< 4-byte header »|4 114-byte payload ► 

0 1 2 3 4 113 


| FID=5 | N=114 


Seq. Num=59 


Struct Ptr=3 


0 


1 


BIP-4 








J1 






FID=5 


N=114 


Seq. Num=60 


0x3FF 


0 


1 


BIP-4 














FID=5 


N=114 


Seq. Num=61 


0x3FF 


0 


1 


BIP-4 














FID=5 


N=114 


Seq. Num=62 


0x3FF 


0 


1 


BIP-4 














FID=5 


N=114 


Seq. Num=63 


0x3FF 


0 


1 


BIP-4 














FID=5 


N=114 


Seq. Num=64 


0x3FF 


0 


c 


BIP-4 













Figure 3-3 STS-1 SPE Data Blocks and Headers 



The flow ID of each TDM packet is set to 5 and payload size (N) to 1 14 to indicate a 
flow #5 STS-1 TDM packet. Only the first packet, sequence number = 59, has a valid 
structure pointer points to the Jl byte in the payload area. Other pointers are invalid and 
set to 0x3FF. The STS-1 has a positive justification event in the frame and the PJE bit is 
set for five consecutive blocks from 59 to 63. 

If the TDM circuit is in a path alarm indication signal (AIS) state, then both the PJE and 
NJE bits are set for the duration of the AIS state. In path AIS state, the structure pointer 
field is set to 0x3FF and all payload bytes are set to OxFF. Other fields remain the same. 

3.3.3 Summary 

Table 3-1 summarized the block and HDLC frame size of various encapsulated TDM 
circuits. The block size is number of TDM data bytes. The HDLC frame size includes 19 
bytes of overheads. The size of overheads is for reference only. Extra bits for HDLC 
synchronization and transparency purposes may be added to the overheads. This bit 
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stuffing may further reduce the payload capacity in an OC-192c (9,584.64 Mb/s) trunk 
line. The OC-48c trunk line, which has 2,396.16 Mb/s of payload capacity, is also listed 
for comparison. 
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Table 3-1. Summary of Various TDM Data Streams 



There are two block sizes listed for an STS-l SPE: 114 and 242 bytes. After adding the 
TDM and Viva headers, the size of a Viva packet becomes 128 or 256 bytes, which is a 
multiple of 64 bytes. The larger-size Viva packet (256 bytes) is more efficient in 
bandwidth use but has longer SAR delay. 

Similarly, both the STS-3c and STS-12c circuits are listed with two block sizes each for 
comparison. Smaller block sizes (shaded rows), such as 114 bytes for STS-l, 432 bytes 
for STS-3c, and 624 bytes for STS-l 2c, are used in this document. 

The size of an HDLC frame is the TDM block size plus total packet overheads (19 bytes). 
The total packet overheads consists of a four-byte TDM header, two four-byte MPLS 
labels, a four-byte PPP header, an HDLC flag, and a two-byte FCS. The HDLC frame 
size is used to calculate the bandwidth requirement of transporting a TDM circuit in a 
trunk line. 

Entries in the "# Packets Per Second" column are calculated as SPE size per second 
(783*8,000 = 6,264,000 bytes for STS-l) divided by block size (1 14 bytes for STS-l). 
Entries in the "Bandwidth Required (Mb/s)" column are calculated as # packets per 
second times HDLC frame size (133 bytes for STS-l) times eight bits per byte. The last 
two columns list maximum number of TDM circuits that can be fit in an OC-48c or OC- 
192c line, along with their percent fill. 
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